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Abstract — This paper shows that the solutions to various 
convex £i minimization problems are unique if and only if a 
common set of conditions are satisfied. This result applies broadly 
to the basis pursuit model, basis pursuit denoising model, Lasso 
model, as well as other i\ models that either minimize f(Ax — b) 
or impose the constraint f(Ax — b) < a, where / is a strictly 
convex function. For these models, this paper proves that, given 
a solution :c* and defining / = supp(x*) and s = sign(a;|), x* is 
the unique solution if and only if Ai has full column rank and 
there exists y such that Ajy — s and \afy\ac < 1 for i I. 
This condition is previously known to be sufficient for the basis 
pursuit model to have a unique solution supported on I. Indeed, 
it is also necessary, and applies to a variety of other i\ models. 
The paper also discusses ways to recognize unique solutions and 
verify the uniqueness conditions numerically. 

Index Terms — basis pursuit, l\ minimization, solution unique- 
ness, strict complementarity 

I. Introduction 

Let x € R" be the decision variable. This paper studies the 
unique solutions of the l\ minimization problems including 
the basis pursuit problem (8) 

min 1 1 a; 1 1 1 s.t. Ax = b (la) 

and convex problems 

min/i(Ar-&) + A||x||i, (lb) 
min ||ac||i, s.t. f 2 (Ax - b) < a, (lc) 
min / 3 ( Ax — b) , s.t. ||x||i < r, (Id) 

where A, <r, t > are scalar parameters, A is a matrix, and 
fi(x),i — 1,2,3 are strictly convex functions. The Lasso 
problem [21] is a special case of problem (JTbJ or (JTdJ while 
the basis pursuit denoising problem [8] is a special case of 
problem ([TcJ all with /<(•) = i|| • |||, i = 1,2,3. 

There is a rich literature on analyzing, solving, and applying 
problems in forms of (|Ta]>— (|Td]> in the communities of infor- 
mation theory, signal processing, statistics, machine learning, 
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optimization, and so on. In many cases, problems (fTa|)-(fTd|) 
need to have unique solutions; when there are more than one 
solution, the set of solutions is a convex set including an 
infinite number of solutions. In compressive sensing signal 
recovery, having non-unique solutions means that the under- 
lying signal can not be reliably recovered from the given data. 
In feature selection, non-unique solutions cause ambiguity 
for feature identification. Even certain optimization methods 
and algorithms, especially those producing the solution path 
of ([Tb])— (jTdJ over varying parameters such as LARS lfl4l 
and parametric quadratic programming 0J, require solution 
uniqueness; they will fail (or need special treatments) upon 
encountering non-unique solutions. Therefore, establishing a 
condition of solution uniqueness is important for both the 
analysis and computation of problems (jTaJi— (|Tdj> . Fortunately, 
there are various sufficient conditions guaranteeing solution 
uniqueness in problem ( fla| ), such as Spark ifTOl . 0, the mu- 
tual incoherence condition ifTTIl . Ifl5l . the null-space property 
(NSP) (HI, 0, the restricted isometry principle (RIP) (3], 
the spherical section property [24|, the "RIPless" property (3), 
and so on. Some conditions guarantee the unique recovery of 
a given solution or solutions with a given set of signs; other 
conditions provide the guarantees for all solutions with suffi- 
ciently few nonzero entties. However, none of them is known 
to be both necessary and sufficient for solution uniqueness in 
problems (JTbJi— ((Tdj) . This paper shows that given a solution 
x* to any problem among (|Ta]>— (|Td]>, Condition [T] below is 
both necessary and sufficient for x* to be the unique solution. 
Hence, it is weaker than the sufficient conditions listed above. 

We let X, X\, Y a , and Z T denote the sets of solutions to 
problems (flal>-([Td|, respectively. We let a, be the ith column 
of A and x< be the ith entry of x. Given an index set /, we 
frequently use At as the submatrix of A formed by its columns 
ai, i € I and xi as the subvector of x formed by entries Xi, 

iel. 

Our analysis makes the following assumptions: 

Assumption 1. Matrix A has full row rank. 

Assumption 2. The solution sets X, X\, Y a , and Z T of 
problems ([Ta|)-(fTd]>, respectively, are nonempty. 

Assumption 3. In problems (f!b|)-(fTd|), functions f\,fi, fd, ore 

strictly convex. In addition, the constraint of problem ( |ld| l is 
bounding, namely, t < inf{||x||i : fs(Ax — b) = f£}, where 
fa '■= min^gRn f(Ay - b). 

Assumptions [T] and [2] are standard. If Assumption[T]does not 
hold and Ax — b is consistent, the problems can be simplified; 
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specifically, one can decompose A = 

that and Ai has full row rank equal to rank(A), and one can 
replace the constraints Ax = b by A±x = bi and introduce 
functions /j so that fi{A\X — bi) = fa(Ax — b), i = 1,2,3. 
Assumption [2] guarantees that the solutions of problems (fTa]>- 
( p~d| > can be attained so the discussion of solution uniqueness 
makes sense. The strict convexity of fi, fat /3 an d the restric- 
tion on r in Assumption [3] are also fairly basic toward solution 
uniqueness. Strict convexity rules out piece-wise linearity. 
(Note that /i,/2,/3 can still be non-differentiable.) If the 
restriction on r is removed, the solution uniqueness of problem 
(JTdJ becomes solely up to f%(Ax — b), independent of ||x||i. 

For a given vector x* , the following conditions on matrix A 
is the key to solution uniqueness, and its sufficiency has been 
established in lfT6ll . 

Condition 1. Under the definitions I :— supp(x*) C 
{1, ...,n} and s := sign(xj), matrix A 6 R roxn has the 
following properties: 

1) submatrix Aj has full column rank, and 

2) there is y £ R m obeying Ajy — s and H-AjcJ/Hoo < L 

The main theorem of this paper asserts that Condition [T] is 
both necessary and sufficient to the uniqueness of solution x* . 

Theorem 1 (Solution uniqueness). Under Assumptions UW\ 
given that x* is a solution to problem ( fTa} , \\b\ , ( fTc I, or ( |ld| ~ 
x* is the unique solution if and only if Condition [7 holds. 

In addition, combining Theorem [T] with the optimality 
conditions for problems (jTaJi— (|Td]», the following theorems give 
the necessary and sufficient conditions of unique optimality for 
those problems. 

Theorem 2 (Basis pursuit unique optimality). Under Assump- 
tions [7}j2] x* € R™ is the unique solution to problem ( |la[ i if 
and only if Ax* = b and Condition [JJ is satisfied. 

Theorem 3 (Problems (fTb))-([Td|) unique optimality). Under 
Assumptions [TJji] and the additional assumption f\ , / 2 , f% G 
C , x* € R" is the unique solution to problem (JTbJ, ( |Tc] >, or 
if and only if respectively, 

3 p* e d\\x*\\x,3p* + XA T Wf!(Ax* 



b)=0, 



f(Ax*-b)<a and 3 p* e d\\x*\\i,r] > 0, 
3 p* + rjA T Vf 2 {Ax* - b) = 0, or 



(2a) 



(2b) 



||x*||i<r and 3 p* e d\\x*\\ u v > 0, 

3 vp* + A T Vf 3 (Ax* - b) = 0, (2c) 

and in addition Condition [JJ holds. 

The proofs of these theorems are given in Section \H\ below. 

A. Related works 

Since the sufficiency is not the focus of this paper, we do not 
go into more details of the sufficient conditions that have been 
mentioned above. We just point out that several papers such 



as |[T6l . HH construct the least-squares (i.e., minimal i^-norm) 
solution y of Ajy = s and establish sufficient conditions for 
ll^lcj/lloo < 1 to hold. Next, we review the existing results 
on necessary conditions for the uniqueness of i\ minimizer. 

Work [4] considers problem ( fTa} with complex- valued quan- 
tities and A equal to a down-sampled discrete Fourier operator, 
for which it establishes both the necessity and sufficiency of 
Condition 1 to the solution uniqueness of ( fTa} . Their proof 
uses the Hahn-Banach separation theorem and the Parseval 
formula. Work l23l lets the entries of matrix A and vector x 
in problem ( fTa} have complex values and gives a sufficient 
condition for its solution uniqueness. In regularization theory, 
Condition 1 is used to derive linear error bounds under the 
name of range or source conditions in |18|, which shows 
the necessity and sufficiency of Condition 1 for solution 
uniqueness of ( fTa| > in a Hilbert-space setting. More recently, 
lfT3ll constructs the set 

¥ = {x: ||Aj c A J (^A J )- 1 sign(x J )|| 00 < 1 and 
rank(ylj) = \ J\}, where J = supp(x), 

and then states that the set of vectors that can be recovered by 
problem ( fTa} is exactly characterized by the closure of F if the 
measurement matrix A satisfies the so-called general position 
(GP) condition, namely, for any sign vector s 6 { — 1,1}", 
the set of columns {A 1 } of A G R mx ™ satisfying that any k- 
dimensional affine subspace of W\ k < m, contains at most 
k + 1 points from the set {siA 1 }. This paper claims that the 
result holds without the GP condition. 

To our knowledge, there are few conditions addressing the 
solution uniqueness of problems (jTbJ— (jTd]i . The following 
conditions in [16|, ifTTl are sufficient for x* to the unique 
minimizer of ( fib) for /i(-) = ||| ■ \\\. 



Aj(b - Aix*j) = A • sign(x*j), 



\Af a (b- Ajx^Hoo < A, 



(3a) 
(3b) 

Aj has full column rank. (3c) 

However, they are not necessary as demonstrated by the 
following example. Let 
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1 



A = 1 



(4) 



and consider solving the Lasso problem, which is a special 
case of problem ( fTb| ): 

1, 



mm ^ll^ 2 ' ~ HI2 + A||a;||i. 



(5) 



[0 1/4 0] T and I 



One gets the unique solution x* 
supp(x*) = {2}. However, the inequality in condition (3bi 



holds with equality. In general, conditions Q becomes nec 
essary in case A] happens to be a full rank square matrix. 
This assumption, however, does not apply to a sparse solution 
x*. Nevertheless, we summarize the result in the following 
corollary, whose proof is given at the end of Section [II] 

Corollary 1. If x* is the unique minimizer of problem ( |lb[ ) 
with fi(-) = ||| • || 2 and if Aj, where I = supp(x*), is a 
square matrix with full rank, then condition Q holds. 
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Very recently, work [22] investigates the solution uniqueness 
of |5]l and presents the following result. 

Theorem 4 fll22l ). Let x* be a solution of |5]) and J := {i : 

\af (b — Ax*)\ — A}. If submatrix Aj is full column rank, then 
x* is unique. Conversely, for almost every b E M. m , if x* is 
unique, then Aj is full column rank. 

In Theorem |4] the necessity part "for almost every b" is 
new. Indeed, it is not for every b. An example is given in (f4f) 
with a unique solution x* and J = {1,2,3}, but Aj does 
not full column rank. On the other hand, we can figure out a 
special case in which the full column rankness of Aj becomes 
necessary for all b in the following corollary, whose proof is 
given at the end of Section |H| 

Corollary 2. Let x* be a solution of problem (|5]l and define 
I := supp(x*) and J := {i : \af{b - Ax*)\ = A}. If \ J\ = 
\I\ + 1, then x* is the unique solution if and only if Aj has 
full column rank. 

II. Proofs of Theorems [TJ-[3] 

We establish Theorem [TJ in three steps. Our first step proves 
the theorem for problem (fTa) only. Since the only difference 
between this part and Theorem [2] is the conditions Ax* = b, 
we prove Theorem [2] first. In the second step, for problems 
([Tb|i-([Td|, we show that both ||x||i and Ax — b are constant 
for x over the solution sets X\,Y a , Z T , respectively. Finally, 
we prove Theorem [TJ for problems (jTbJ— (jTdJ . 

Proof of Theorem |2j We frequently use the notions I = 
supp(x*) and s = sign(x*j) below. 

This part has been shown in fl6l . If23ll . For com- 
pleteness, we give a proof. Let y satisfy Condition [TJ part 2, 
and let x E M. n be an arbitrary vector satisfying Ax = b and 
x 7^ x*. We shall show ||se*||i < ||a;||i. 

Since Aj has full column rank and x ^ a;*, we have 
supp(x) 7^ /; otherwise from Ajx*- = b = Ajxj, we would 
get x} = xi and thus the contradiction x* = x. 

From supp(x) ^ I, we get b T y < \\x\\i. To see this, let 
J := suppfx) \ /, which is a non-empty subset of I c . From 
Condition nj we have HAjj/Hoo = 1 and HAjj/Hoo < 1, and 
thus 

(x I ,Ajy)<\\x I \\ 1 .\\Aj y \\ 00 <\\x I \\ l , 

(xj,A T jy ) < \\xj\\i ■ Pjj/Hoo < \\xjWx, 

(the last inequality is "<" not "<") which lead to 

b T y = (x, A T y) = (xi,Afy) + (xj, A T jV ) 
< ||x 7 ||i + = \\x\\i. 

On the other hand, we have 

Ik'* Hi = ( x *i,sign(x*j)) = (x*j,Ajy) = (Aix},y) =b T y 
and thus ||x*||i = b T y < \\x\\\. 

"=>". Assume that x* is the unique solution to ( fTa) . Obvi- 
ously, Ax* = b. 

It is easy to obtain Condition [TJ part 1. Suppose it does not 
hold. Then, Aj has a nontrivial null space, and perturbing x*- 



along the null space will change the objective \\xj\\i — s T x* I 
while maintaining Aix*- = b; hence, this perturbing breaks 
the unique optimality of x*. (In more details, there exists a 
nonzero vector d G W l such that Ajdj = and die = 0. For 
any scalar a near zero, we have sign(x} + adj) — sign(x}) = 
s and thus \\x* +ad\\i — s T (x* I + ad I ) — s T x*- +a(s T dj) = 
\\x*\\i + a(s T di). Since x* is the unique solution, we must 
have \\xj + ad\\i > \\x*\\i or, equivalently, a(s T di) > 
whenever a ^ 0. This is impossible as we can perturb a 
around both ways.) 

It remains to construct a vector y for Condition [TJ part 2. 
Our construction is based on the strong convexity relation 
between a linear program (called the primal problem) and 
its dual problem, namely, if one problem has a solution, so 
does the other, and the two solutions must give the same 
objective value. (For the interested reader, this result follows 
from the Hahn-Banach separation theorem, also from the 
theorem of alternatives JTJ. Alternatively, it can be obtain 
constructively via the Simplex method; specifically, whenever 
a primal solution exists, the Simplex method terminates in a 
finite number of steps with a primal-dual solution pair.) 

The strong duality relation holds between ( fTa} and its dual 
problem 

max6 T p s.t. H^pIIoo < 1 (6) 

because ( fTa) and |6]), as a primal-dual pair, are equivalent to 
the primal-dual linear programs 



max b T q s.t. - 1 < A T q < 1, 



min 1 u + 1 v s.t. Au — Av — b, u > 0, v > 0, (7a) 

u,t>€R n 

(7b) 



respectively, where the strong duality relation holds between 
( fTaf i and ( fTbf ). By "equivalent", we mean that one can obtain 
solutions from each other by the rules: 

given u* ,v* , obtain x* = u* — v* 

given x* , obtain u* = max(a;*,0), v* — max(— x*,0), 

given q* , obtain p* = q* , 

given p* , obtain q* = p* . 

Therefore, since ( fTa) has solution x* , there exists a solution y* 
to ((SJ, which satisfies ||a;*||i = b T y* and ||A T y*|| 00 < 1. (One 
can obtain such y* from the Hahn-Banach separation theorem 
or the theorem of alternatives rather directly.) However, y* 
may not obey ||Aj (! 2/*|| 00 < 1. We shall perturb y* so that 

llA£iriioo < i. 

To prepare for the perturbation, we let L := {i 6 I c : 
ajy* = -1} and U := {i E I c : afy* — 1}. Our goal is 
to perturb y* so that -1 < afy* < 1 for i E L U U and y* 
remains optimal to ([6j. To this end, consider for a fixed a > 
and t := ||a;*||i, the linear program 



min > OLXi 



OLXi, s.t. Ax — b, \\x\\\ < t. 



(8) 



Since x* is the unique solution to ( fTa) , it is the unique 
feasible solution to problem ([SI, so problem ([8]) has the optimal 
objective value Y^ieu ax i ~ YieL ax *i = 0- setting up 
equivalent linear programs like what has been done for ( fTa) 
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and |6} above, the strong duality relation holds between ([8]) 
and its dual problem 

max b T p — tq, s.t. II A T p — aril a, < q, q > 0, (9) 

pSR m ,gGR 

where r £ M n is given by 

1, i6l, 

-1, i £ U, 

0, otherwise. 

Therefore, |9]) has a solution (p*,q*) satisfying b T p*—tq* = 0. 

According to the last constraint of |9]), we have q* > 0, 
which we split into two cases: g* = and > 0. 

i) If q* = 0, we have A T p* — ar and b T p* — 0. 

ii) If q* > 0, we let r* := p* / q* , which satisfies 6 T r* = 



< 1, or equivalently, 



i = ||x*||i and ||A T r* - ^r| 
-1 + 4r < A T r* < 1 + -%r. 

q* — — 9* 

Now we perturb y* . Solve Q with a sufficiently small a > 
and obtain a solution (p*,?*). If case i) occurs, we let y* <— 
y* + p*; otherwise, we let y* <— h(y* + r*). In both cases, 

• b T y* is unchanged, still equal to ||x*||i; 
. -1 < afy* < 1 holds for i £ L U U after the 
perturbation; 

. for each i g L U U, if ajy* € [-1, 1] or ajy* e (-1, 1) 
holds before the perturbation, the same holds after the 
perturbation; 
Therefore, after the perturbation, y* satisfies: 

1) &V = ||a:li, 

2) \\Ajy*\\ x < 1, and 

3) Pfe^lU < 1. 

From 1) and 2) it follows 

4) Ajy = sign(x*) 

since ||xf||i = ||x*||i = b T y* = (Ajx^y*) = (x}, Ajy*) < 
Ik/lliPVlloo < Il4lli and thus {x*j,Ajy*) = \\x}\\ lt 
which dictates 4). From 3) and 4), Condition [T] part 2, holds 
with y = y*. ■ 
Proof of Theorem [7]/or problem ( fTa) : The above proof 
for Theorem [2] also serves the proof of Theorem [TJ for problem 
( fTa] ) since Ax* = b is involved only in the optimality part, not 
the uniqueness part. ■ 
Next, we show that Ax—b is constant for x over X\, Y a , Z T , 
and we first prove a simple lemma. 

Lemma 1. Let f be a strictly convex function. If f(Ax — b) + 
|| x ||i is constant on a convex set S, then both Ax — b and 
|| £ ||l are constant on S. 

Proof: It suffices to prove the case where S has more one 
point. Let x\ and xn be any two different points in S. Consider 
the line segment L connecting Xi and x 2 - Since X is convex, 
we have Lcl and that f{Ax— 6)+||x||i is constant on L. On 
one hand, ||a;||i is piece-wise linear over L; on the other hand, 
the strict convexity of / makes it impossible for f(Ax — b) to 
be piece-wise linear over L unless Ax\ — b = Ax^ — b. Hence, 
we have Ax^ — b — Ax 2 — b and thus f{Ax\ — b) = f(Ax 2 —b), 
from which it follows ||xi||i = || 1| a - Since x\ and x 2 are 
arbitrary two points in S, the lemma is proved. ■ 



With Lemma Q] we can show 

Lemma 2. Under Assumptions [2] and [i] the following state- 
ments for problems ( |lb| i-( fTdl i hold 

1) X\,Y a and Z T are convex; 

2) In problem jib) , Ax — b and \\x\\x are constant for all 
x € X x ; 

3) Part 2) holds for problem ( TcJ and Y a ; 

4) Part 2) holds for problem (W]) and Z T . 

Proof: Assumption [2] makes sure that X\,Y a ,Z T are all 
non-empty. 

1) As a well-known result, the set of solutions of a convex 
program is convex. 

2) Since fi{Ax— 6)+A||x||i is constant over x E X\ and fx 
is strictly convex by Assumption [3] the result follows directly 
from Lemma Q] 

3) If £ Y a , then the optimal objective is ||0||i = 0; hence, 
Y\ = {0} and the results hold trivially. Suppose ^ Y a . Since 
the optimal objective ||x||i is constant for all x € Y a and f 2 
is strictly convex by Assumption [3] to prove this part in light 
of Lemma [TJ we shall show f 2 (Ax — b) = a for all x € Y a . 

Assume that there is x G Y„ such that f 2 (Ax — b) < a. 
Since f 2 (Ax — b) is convex and thus continuous in x, there 
exists a non-empty ball B centered at x with a sufficiently 
small radius p > so that f 2 (Ax — b) < a for all x € B. 
Let a = min{ 2 ^ ||2 , |} € (0, 1). We have (1 - a)x £ B 
and ||(1 — a)i||i = (1 — < ||x||i, so (1 — a)x is 

both feasible and achieving an objective value lower than the 
optimal one. Contradiction. 

4) By Assumption [3] we have ||x||i = r for all x G Z T ; 
otherwise, there exists x E Z T such that t > fs(Ax — b) > 
inf{||x||i : fz{Ax — b) = /|}, contradicting Assumption [3] 
Since the optimal objective f$(Ax — b) is constant for all 
x £ Z T and fa is strictly convex by Assumption [3] the result 
follows from Lemma Q] ■ 

Proof of Theorem [7]/or problems (fTb|)-(fTd|): This proof 
exploits Lemma [2] Since the results of Lemma [2] are are 
identical for problems (|Tbt>— (p~dl>, we present the proof for 
problem ( fib} . The proofs for the other two problems are 
similar. 

From Assumption [3] X\ is nonempty so we pick x* £ 
X\. Let b* = Ax*, which is independent of the choice of x* 
according to Lemma [2] We introduce the linear program 

min||x||i, s.t. Ax = b*, (10) 

and let X* denote its solution set. 

Now, we show that X\ = X*. Since Ax = Ax* and ||x|| 1 = 
|| x* ||i for all x £ X\ and conversely any x obeying Ax 
.1,;'" and |jx|ji = ||x*||i belongs to X\, it is suffices to show 
that ||x||i = ||x*||i for any x £ X* . Assuming this does not 
hold, then since problem ( fTO) has x* as a feasible solution 
and has a finite objective, we have a nonempty X* and there 
exists x £ X* satisfying ||x||i < ||x*||i. But, f(Ax — b) = 
f(b* — b) = f(Ax* — b) and ||x||i < ||x*||i mean that x is a 
strictly better solution to problem ( fTb] > than x* , contradicting 
the assumption x* £ X\. 

Since X\ — X* , x* is the unique solution to problem ( fib] ) 
if and only if it is the same to problem (jT0j». Since problem 
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( |T0| > is in the same form of problem ([Taj, applying the part 
of Theorem [TJ for problem (|Ta|l, which is already proved, we 
conclude that x* is the unique solution to problem (JTbJ if and 
only if Condition [Tj holds. ■ 
Proof of Theorem The proof above also serves 
the proof for Theorem pTsince ( 2a]i-( 2c| are the optimality 
conditions of x* to problems ( Tb]>— ( Id), respectively, and 
furthermore, given the optimality of x* , Condition [TJ is the 
necessary and sufficient condition for the uniqueness of x* . 

■ 

Remark 1. For problems ( [lb) — ( [Id) , the uniqueness of a given 
solution x* 7^ is also equivalent to a condition that is slightly 
simpler than Condition [TJ To present the condition, consider 
the first-order optimality conditions ( the KKT conditions) (|2a|l- 
( pcj ) of x* to problems ( |lb| )-( fTd| ), respectively, Given x* ^ 0, 
r\ and v can be computed. From p* ^ it follows that jj > 0. 
Moreover, v = if and only if A T V f 3 (Ax* — b) = 0. The 
condition below for the case v = in problem ( |ld| l reduces 
to Condition [TJ Define 

Pi ={z : |AafV/i(Ac* - 6)| = 1}, 
P 2 ={z:hafV/ 2 (Ax*- 6)| = 1}, 
P 3 ={i:\aJVf 2 (Ax* -b)\=v}. 

By the definitions o/9||a;*||i and Pi, we have supp(x*) C P it 
i = 1,2,3. 

Condition 2. Under the definitions I := supp(x*) C P i and 
s := sign(x*j), matrix Ap i € R rnX l- R »l obeys 

1) submatrix Aj has full column rank, and 

2) there exists y G M m such that Ajy — s and 
P£ AJ 2/||oo < 1. 

Compared to Condition [TJ Condition [2] only checks the sub- 
matrix Ap i but not the full matrix A. 



It is not difficult to show that the linear programs 

min||x||i, s.t. (ApJ)x = b* , 

for i = 1,2,3, have the solution sets that are equal to 
X\ . Y a , Z T , respectively. From this argument, we have 



Theorem 5. Under Assumptions and the additional con- 
dition that fi , / 2 , /a € C , given that x* ^ is a solution to 
problem \Vo\ , ( fTcj ), or ( jld| l, x* is the unique solution if and 
only if Condition [2] holds for i = 1, 2, or 3, respectively. 

Proof of Corollary [7J From Theorem [3] if x* is the 
unique minimizer of problem (jTbJ with /i(-) = \\\ • |||, then 
Condition 1 holds, so there must exist a vector y such that 
Ajy = s and ||v4.j c y||oo < 1- Combining with (3ai, we have 



\Ajy = \s = Aj{b-A I x*). 

Since Aj is a full rank square matrix, we get y = j(b — 
A[X*). Substituting this formula to 1 1 ^4 J/ 1 1 oo < 1, we obtain 
condition ((3). 

■ 

Proof of Corollary ^ The sufficiency part follows from 
Theorem |4] We shall show the necessity part, namely, if x* is 
the unique solution, then Aj has full column rank. Following 



the assumption \ J\ = |/| + 1, we let {io} = J\I. Since x* is 
the unique solution, from Theorem [5] we know that Aj has 
full column rank. Hence, if Aj does not have full column 
rank, then we can have a; = Aif3 for some (3 e W 1 '. From 
Theorem [3] if x* is the unique minimizer, then Condition [T] 
holds, and in particular, there must exist a vector y such that 
Ajy = s and ||^4j c y||co < 1. Now, on one hand, as io G 
I c , we get 1 > \af Q y\ = \/3 T Ajy\ = \/3 T s\; on the other 
hand, as i 6 J, we also have \af (b — Ax*)\ = A, which 
implies 1 = \\aJ o {b-Ax*)\ = ^A T (b - Ax*)\ = |/3 T s|, 
where the last equality follows from ( ffaj i (which includes (pa)). 
Contradiction. ■ 

III. Recognizing and verifying unique solutions 

Applying Theorem [Tj we can recognize the uniqueness of a 
given solution x* to problem ( fTa) given a dual solution y* (a 
solution to problem |6])). In particular, let J := {i : \ajy*\ = 
1}, and if Aj has full column rank and supp(x*) = J, then 
according to Theorem [TJ x* is the unique solution to ( fTa) . 
The converse is not true since there generally exist multiple 
dual solutions which have different J. However, several linear 
programming interior point methods (see [19| for example) 
return the dual solution y* with the smallest J, so if either 
A j is column-rank deficient or supp(x*) ^ J, then x* is 
surely non-unique. 

Corollary 3. Under Assumption^ given a pair of primal-dual 
solutions (x*,y*) to problem ( fTa] ), let J :— {i : \ajy*\ = 1}. 
Then, x* is the unique solution to ( |la| > if Aj has full column 
rank and supp(a;*) = J. In addition, if y* is obtained by 
a linear programming interior-point algorithm, the converse 
also holds. 

Similar results will also hold for problems (|Tb|>— (|Tdj> if a 
dual solution y* to ( fTO) is available. 

One can also directly verify Condition [TJ Given a matrix 
A € E mxn , a set of its columns indexed by /, and a sign 
pattern s = { — 1, l}' 7 ', we mention two approaches to verify 
Condition [TJ Checking whether Aj has full column rank is 
straightforward. To check part 2 of Condition [TJ the first 
approach is to follow the proof of Theorem [TJ Note that 
Condition [TJ depends only on A, I, and s, independent of x* . 
Therefore, construct an arbitrary x* such that supp(x*) = / 
and sign(a;j) = s and let b = Ax*. Solve problem Q and 
let y* be its solution. If y* satisfies part 2 of Condition [TJ we 
are done; otherwise, define L, U, and t by x* as in the proof, 
pick a small a > 0, and solve program |9| parametrically 
in a £ [0, a]. The solution is piece-wise linear in a (it is 
possible that the solution does not exist over certain intervals 
of a). Then check if there is a perturbation to y* so that y* 
satisfies part 2 of Condition [TJ 

In the second approach to check part 2 of Condition [TJ one 
can solve the convex program 



^log(l-afy)+log(l + afy), 
iei" 

T 



(ID 



s.t. Ajy = s 



Since ajy — >• 1 or ajy — > —1 will infinitely increase the 
objective, ( [TT| will return a solution satisfying Condition [TJ 
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part 2, as long as a solution exists. In fact, any feasible solution 
to ( fTTj i with a finite objective satisfies Condition [T] part 2. 
To find a feasible solution, one can apply the augmented 
Lagrangian method, which does not require Ajy = s to hold 
at the initial point (which must still satisfy \a[y\ < 1 for all 
i G I c ), or one can consider applying the alternating direction 
method of multipliers (ADMM) to the equivalent problem 

min- V" log(l - Zi) + log(l + Zi), 

iei a (12) 
s.t. Ajy = s, z - Aj c y = 0. 

One can start ADMM from the origin, and the two subprob- 
lems of ADMM have closed-form solutions; in particular, the 
z-subproblem is separable in zfs and reduces to finding the 
zeros of 3 -order polynomials in z,-, i £ I c . If ( fT2| ) has a 
solution, ADMM will find one; otherwise, it will diverge. 

It is worth mentioning that one can use alternating projec- 
tion in ||20l to generate test instances that fulfill Condition 

m 

IV. Conclusions 

This paper shows that Condition [T] which is previously 
known to be sufficient for the solution uniqueness of the 
basis pursuit model, is also necessary. Moreover, the condition 
applies to various l\ minimization models. The result essen- 
tially follows from the fact that a pair of feasible primal-dual 
programs have strict complementary solutions. The result also 
sheds light on numerically recognizing unique solutions and 
verifying solution uniqueness. 
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